Loop-corrected belief propagation for lattice spin models
نویسندگان
چکیده
Belief propagation (BP) is a message-passing method for solving probabilistic graphical models. It is very successful in treating disordered models (such as spin glasses) on random graphs. On the other hand, finite-dimensional lattice models have an abundant number of short loops, and the BP method is still far from being satisfactory in treating the complicated loop-induced correlations in these systems. Here we propose a loop-corrected BP method to take into account the effect of short loops in lattice spin models. We demonstrate, through an application to the square-lattice Ising model, that loop-corrected BP improves over the naive BP method significantly. We also implement loop-corrected BP at the coarse-grained region graph level to further boost its performance. PACS. 02.70.Rr General statistical methods – 75.10.Nr Spin-glass and other random models – 07.05.Pj Image processing – 05.50.+q Lattice theory and statistics (Ising, Potts, etc.)
منابع مشابه
Loop corrections for message passing algorithms in continuous variable models
In this paper we derive the equations for Loop Corrected Belief Propagation on a continuous variable Gaussian model. Using the exactness of the averages for belief propagation for Gaussian models, a different way of obtaining the covariances is found, based on Belief Propagation on cavity graphs. We discuss the relation of this loop correction algorithm to Expectation Propagation algorithms for...
متن کاملPartition function loop series for a general graphical model: free energy corrections and message-passing equations
A loop series expansion for the partition function of a general statistical model on a graph is carried out. If the auxiliary probability distributions of the expansion are chosen to be a fixed point of the belief-propagation equation, the first term of the loop series gives the Bethe-Peierls free energy functional at the replicasymmetric level of the mean-field spin glass theory, and correctio...
متن کاملSTATS 375 - Project Proposal
Belief propagation is a message-passing algorithm for performing inference in graphical models that has been implemented in a variety of domains including artificial intelligence, information theory and statistical physics. As we know, BP provides exact results only on a relatively restrictive subclass of problems, when the graphical model is a tree (or more generally if each connected componen...
متن کاملStatistical physics of loopy interactions: Independent-loop approximation and beyond
We consider an interacting system of spin variables on a loopy interaction graph, identified by a tree graph and a set of loopy interactions. We start from a high-temperature expansion for loopy interactions represented by a sum of non-negative contributions from all the possible frustration-free loop configurations. We then compute the loop corrections using different approximations for the no...
متن کاملMathematical structures of loopy belief propagation and cluster variation method
The mathematical structures of loopy belief propagation are reviewed for graphical models in probabilistic information processing in the stand point of cluster variation method. An extension of adaptive TAP approaches is given by introducing a generalized scheme of the cluster variation method. Moreover the practical message update rules in loopy belief propagation are summarized also for quant...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1505.03504 شماره
صفحات -
تاریخ انتشار 2015